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ABSTRACT 

A pictorial-rating-^cale sociometric instrument was 
administered to 91 mTddle-socioeconomic status first- and third-grade 
children two times, four weeks apart under two conditions, using a 
three-step and a five-step rating scale. No sigriificant overall 
differences in reliability was found between the three-step and the 
five-step scale. However, in the first-grade classes, the five-step 
scale was more reliable. The three-step instrument was shown to have 
reliability comparable witli that found using similar procedures with 
preschool children. The qii^stion of sex bias in the inst^timent was 
also examined. Although saine-sex peers rated children higher than 
opposite-sex peers, and the difference was even greater at the , * 
third-grade level, the same-sex scores correlated highly with the " 
combined score from both sexes. (Author) 
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' Abstract 

A pictorial-rating-scale sociometric instrument was admin- 
istered to 91 middle-SES first- and third-grade children two 
times, four weeks apart under two conditions, using a three-step 
and a five-step rating scale. No significant overall differ- 
ences in reliability was found between the three-step and the 
five-step scale. However, in the first-grad6 classes, the five- 
s' step scale was more reliable. The t^ree-step instrument was 
shown to have reliability comparable with that found using sim- 
ilar procedures with preschool children. The question of sex 
bias in the instrument was also examined. Although same-sex 
peers rated children higher than opposite-sex peers, and the 
difference was even greater at the third-grade level, the same- 
sex scores correlated highly with the combined score from both 
sexes . 
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The Pictorial-Ratins -Scale Sociometric: 



A Comparison of Two Forms of Administration 



Sociometric methodology has been shown to be valid and re- 
liable for identifying children as "at risk" in their peer re- 
lations (Asher & Hymel, 1901). Moreno (1934) developed the most 
commonly used sociometric assessment instrument. In Moreno's 
procedure, as described by Asher, Singleton, Tinsley, and Hymel 
(1979), children were asked to choose three preferred classmates, 
in rank order, according to some specific criterion (e.g., play- 
mate, seating companipn). A child's score is based on the num- 
ber of nominations he or she receives from peers. Negative cri- 
teria (e.g., don't like) have also been used with^ nomination 
sociometrics. Moreno's techniaiie was investigated for relia- 
bility with school-age children by Busk, Ford, and Schtilman 
(1973), who found over an eight -week interval test-retest reli- 
ability coefficients of .76 for fourth-grade children and .84 
for sixth-grade students. 

Because the use of this procedure produced lower relia- 
bility for preschool children than for el«nentary-age children, 
McCandless and Marshall (1957) developed a modification for use 
with preschoolers. Their technique, devised to prevent a memory 
overload for young children , involved using the children's pho- 
1 tographs instead of their names. Using the positive nomination 
procedure, they found the instrument moderately reliable for 
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3- to 5-year-^lds; the reliability coefficients being ,66 and 
.71 at 10-day intervals and .45 at a 20-day interval. 

. Asher et al. (1979) further modified the instriiment, re- 
placing the partial-rank-drder nominations used by McCandless 
and Marshall , (1957) and Moreno (1934) with a rating scale. In 
this method children were asked to rate each classmate on a 
scale according to how much they would like to participate with 
the classmate in a specified activity. The three steps on the 
scale were identified by smiling, neulral, and sad faces, and 
the children sorted their classmates' photographs into boxes 
labeled with the three faces i < 

Asher et al. (1979) used the rating scale to test two 
classes of 4-year-olds, one from a university preschool serving 
predominantly middle-class children, and the other from a pri- 
vate community day care center serving a working class population 
from diverse ethnic groups and paving a higher turnover rate. 
The instrument was found to have a high test-retest correlation 
over a four-week period; the reliabilities being .81 for the 
university preschool class and .74 for the private center. 

Similar rating scales, using names rather than photographs, 
have been used with older elementary-age children by Singleton 
and Asher (1977), Oden and Asher (1977), and Thompson and Powell 
(1951). Thompson and Powell (1951) were the only investigators 
among/ these to report test-retest reliability. They found re- 
liabilities ranging from .94 to .95 for four classroom groups 
ranging in size from 31 to 38. 



Asher et al. (1979) used a three-step rating scale in the 
preschool instrument with choices of like, neutral, and^is- 
like for the photograph-sorting method of adminstration. With 
older children. Singleton and Asher (1977) used a five-step rat- 
ing scalewith choices of like a lot, like, neutral, dislike a 
little, and dislike a lot. The rationale fojr limiting the 
choices to three' for the preschoolers in the Asher et al. (1979) 
study was not given, but it may have been based on the antici- , 
pated difficulty that young children wqjuld have in making the 
fine discriminations required by many categories. 

Guilford (1954) cited studies indicating that an advantage 
is found in using more steps in Likert-type scales, such as 
that used by Asher et al. (1979), because increasing the number 
of steps increases the reliability. The reliability of indi- 
vidual rating scales, according to Guilford (1954), is a mono- 
tonically increasing function of the number of steps. According 
to Nunally (1978), the amount of discrimination provided by 
psychophysical scales increases with the number of scale steps, 
up to 20 steps. Their finding suggests that the reliability of 
the rating scale may be imporved by increasing the number of 
choices on the scale and that the five-step scale used with 
older elementary children would be more reliable than the three- 
step scale previously used with 4-year-olds. 

Another problem in the sociometric testing of ttiis age 
group is that of sex bias. Singleton and Asher (1977). found 
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sex bias present in their study of third-graders, but none was 
found in the Asher et al. (1970) preschool data. The latter 
authors recommend use of ratings from same sex peers when sex 
bias is present. 

The purposes of this research were: (a) to establish test- 
retest reliability on a pictorial rating-scale sociometric in- 
strument with a different population and age group than pre- 
viously investigated, (b) to compare the reliability of two 
fo'rms of administration of the rating-scale sociometric, each 
from using a different number of steps; and (c) to evaluate sex 
bias on the rating scale by comparing same-sex versus opposite- 
sex ratings. , . , ' 

Method 

Subj ects 

, 

The subjects were 91 children, 90 white and 1 black, in 
three classes in a suburban elementary school serving a middle- 
to upper-middle-SES population^ Two first-grade classes having 
23 and 40 students each and a third-grade class having 28 stu- 
dents were used. Of the total group, 53 were boys and 38 were 
girls. 

Procedures 

An adaptation of the sociometric-pictorial-rating scale 
developed by Asher et al. (1970) was administered to the chil- 
dren two times, four weeks apart, by their student teachers, who 
were trained by the investigator and given explicit written ' 
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instructions and scripts for the administration of the instru- 
ment. Individual photographs were taken of all the children. 
Each child was taken out of the classroom and, to assure th« 
understanding of the procedure, given instructions and practice 
in sorting objects and pictures into boxes labeled with the 
faces of various expressions that were to be used in the socio- 
metric sorting. One-half of the boys and one-half^of the girls 
in each class were randomly assigned to the three-step-choice 

f } 9 ^ 

\ condition and the other one-half of each gender was assigned 

to the f ive--step-choice condition. In the three-step-choice 
condition, the children were asked to sort photographs of their 
classmates into three boxes labeled with a happy, a neutral, 
and a sad 'face. The experimenter verbklly labeled the happy- 
face box for photographs of afeildren the child "likes to play 
with a lot,*'' the neutral-face box for photographs of children 
the child ''feels so-so about playing with, 'I and the sad-face 
box for photographs of children the child "does not like to play 

with." In the five-step choice condition, the experimenter ver- 

] 

bally labeled the five bpfxes as above, adding faces between the 
extreme faces and the neutral face. Figure 1 shows the faces 
used as labels, the verbal label given, and the score given for 
the selection of the face. 

Insert Figure 1 about here 

After the children had an opportunity to practice sorting 
objects and pictures, they wre asked to sort their classmates' 
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photographs into the boxes according to how much they liked to 
play with the child in each photograph. Responses were scored 
from 1 to 5, as shown in Figure 1. In order to compare the re- 
liabilities for the three-step- and f ive-^ep-choice conditions, 
two mean scores were computed for each child, one of scores re- 
ceived from children who rated in the three-step procedure and 
the other from children who rated in the five-step procedure. 

To compare same- versus opposite-sex scores, the scores 
received under the three-step anxl the five-step conditions on 
the first administration of the instrument were combined, and 
me0.ns of scores received from same-sex peers, and of scores 
recetlved from opposite-sex peers were computed. 

- Results and Discussio n i 

In ordfer to compare reliabilities of the three-step- and 
the f ive-step-phoice conditions, test-retest correlation co- 
efficients were computed for each condition, and the difference 
between the two correlations was tested for significance. With 
both grade levels combined, the correlation for the three step 
condition was r (89) » .80, £ < .001, and the correlation for 
the five-step condition was r (89) ° .88, £ < .001. These two 
correlation coefficients did not differ significantly, indi- 
eating no difference in test-retest reliability between the 
five-step and the three-step conditions. However, when separate 
correlations were computed for each grade level, a significant 
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difference, z = 2.415, £ < .Olj, was found between the test- 
retest correlations for the three-step, r (61) =» .78, £ < .01, 
and five-step, r (61).= £ < .001, conditions for the first- 

grade children, the five-step correlation being significantly 
higher. 

The means and standard deviations for the three-step- and 
the five-step-choice conditions are presented in Table 1. 

,1 Insert Table 1 about here 

The discrepancy between the grades is difficult to explain 
if we assume that younger children would be more confused by 
the larger number of steps than older children, and thus pake 
more random responses. However, it does substantiate the ex- 
pectation from measurement theory that more steps would tend 
to make a scale more reliable. Thus, there would be an advan- 
tage, because of its greater simplicity, in using the three-step 
scale with lower elementary age children of mixed grades and 
there would be no loss of reliability in decreasing the number 
of steps from five to three for this population. 

To test the hypothesis that reliability of the three-step 
method of administration with the first- and third-grffcle chil- 
dren would be comparable to reliabilities obtained with pre- 
schoolers by Asher et al. (1979), a test-retest correlation for 
the three step condition was computedo Since this correlation, 
r (89) » .80, £ < .001, was comparable to the reliability re- 
ported by Asher et al. (1979)p the hypothesis was supported. 
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and the measure can be considc- d a reliable tool for an in- 
creased age range. ^ 

To test the hypothesis that sex bias is present in the 
rating-scale scoiometric, the mean scores received by children 
from same-sex and opposite-sex peers on the first administration 
of the measure were compared by means of a two-way analysis of 
variance, with a repeated measure. The between subjects vari- 
ables were ratings by sex- and grade, and the within subjects 
variables were same-sex and oppositve-.sex peer rater. A differ- 
ence was found between the same-sex and opposite-sex scores: , 
F (1,87) => 504, £ < .0001. Because the F-ratio was so extra- 
ordinarily high, the scatterplot of scores was examined, and a 
t-test run on the two sets of scores. The means and scatter- 
plot showed a consistent pattern of peer ratings approximately 
1.5 points higher for same-sex "ersus opposite-sex ratings. 
The t-tests shows a jt-ratio comparable to the F-ratio, t (90) - 
18.55, £ < .001. According to Glass and Stanley (1970), the 
square of a t^-variable with n degrees of freedom is an F-variable 
with 1 and n degrees of freedom. The difference between the 
square of the t-ratio (^44) and the F-ratio (504) can be ex- 
plained by the difference in degrees of freedom and the error 
terra. ^ 

A significant interaction was found between the repeated 
measure and grade, F (1,87) - 38, d < .0001. Table 2 shows 

Insert Table 2 about here 
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means and standard deviations received from same and opposite 
sex peers. Th^ craph in Figure 2 shows a disordinal interac- 
tion between grade and same-opposite sex rating. Third-graders 
tended to rate feame-sex 'peers M^her and opposite-sex peers 

lower than first-graders. . , 

' I 



Insert Figure 2 about here 



To determine whether the rating" of both sexes can bo used 

as a measure of a child's social acceptance in a clasi^room, the 

I 

same-sex peer rating was correlated with the rating bjj both 
sexes combined. The correlation was extremely high, r (89) »= 
.82, £ < .001. Even though this part-whole correlation may be 
spuriously high, it is the part-whole correlation that is the 
question of interest here. The conclusion can be drawn from 
this correlation that ratings obtained by both sexes can be used 
interchangeably with same sex ratings. The use of combined sex 
scores would be more efficient as separate computations for the 
sexes would be unnecessary. 

The presence of sex bias is clear for both grade levels, 
and is even greater at the third-grade than at the first-gradt^ 
level. Because only three classes were used and variables svjrbh 
as class size and teacher chiiracterist ics may have influenced 
results, the ANOVA was performed with the class variable as 
well, and nonsignificant results were obtained. It seems that 
preference for same sex peers is well established by the first 
grade and increases by third^ grade. 



Whether "or not this leads to the' recommendation that same- 
,sex ratings should be used when using the instruction as an in- 
^dication of a child's peer acceptance is questionable. Since 
the same-sex scores correlate well. with scoVes from tot h sexes, 
b'bth measures give a picture of the general likeability of a 
child, and whether to use same^sfex or both-sex ratings is an- 
swered by the nature of the research question. The investigator 
must decide whether the question is how much a ch:^ld is liked 
by same-sex peers or by all classmates. Sex bias might change 
a child's overall ranking, however, if there were a much larger^' 
number of pne sex than another In the class group. 

' ■ ' ♦ . 
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- Table 1 

Sociometric Ratings by Three-Step or 
— Five-Step-Choice Condition 







Time 
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Time 


2 




N 




SD 


X 


SD 


xiiiee ouep— uiiOxce 
Condition * 












Both Grades 




3.38 


.63§ 


3.42 
1 

3.03 


.70 


Grade 1 


63 


3.32 


.52 


.73 


Grade 3 


'28 


3.54 


.63 


3.67 


; .58 


Five-Step-Choice 
Condition 








\ 




Both Grades 


91 


3.31 


.60 


3.45 4 


.59 


Grade 1 




3.30 


.69 


3.37 


.67 


Grade 3 


* . 28 


3,35 


.31 


3.61 


.31 
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Tablo ,2 

Sociometric Ratings by Same-Sex or. apposite-Sex 

Peers on the First Administration 

N -X SD 

Same-Sex Peers 

Both Grades 91 4.02 .68" 

Grade I 63 3.93 .71 

Grade 3 28 4.49 .39 

Opposite-Sex Peers' 

Both Grades 91 2.66 .68 

Grade 1 63' 2.74 .73 

Grade 3 .28 2.47 .51 
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Figure Captions 



Figure 1. Labels used for socionfetric sorting^ 
Figure 2. Mean ratings of chilflren by grade and same- 
opposite sex peers. / 
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3-Step Labels 




like a lot 



feel so-so 



don't like 



1 



like a lot 



5-Step Labels 




like some 



teel so-so don't like-much 



don't like at all 

1 . 
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